Practical Hadoop Ecosystem by Deepak Vohra

Practical Hadoop Ecosystem by Deepak Vohra

Author:Deepak Vohra
Language: eng
Format: epub
Publisher: Apress, Berkeley, CA


Speculative Execution

Speculative execution is running multiple attempts for a task simultaneously and using the output from the task that completes first. Speculative execution is used if a job has a slow response time due to a few slow running tasks. In a large job, if a task is taking too much time due to complex and large calculations and high throughput is required, speculative execution should be set to false, as it could increase the job response time instead of reducing it.

You can submit a job on the command line using the hadoop jar command.

hadoop jar <job_jar> JobDriverClass [GENERIC_OPTIONS] args



Download



Copyright Disclaimer:
This site does not store any files on its server. We only index and link to content provided by other sites. Please contact the content providers to delete copyright contents if any and email us, we'll remove relevant links or contents immediately.